Artificial Intelligence 

Search 



Dr Sherin EIGokhy 


1 


Reminder: CSPs 


► CSPs: 

Variables 

Domains 

► Constraints 

Implicit (provide code to compute) 
Explicit (provide a list of the legal tuples) 
► Unary / Binary / N-ary 

► Goals: 

Here: find any solution 

► Also: find all, find best, etc. 





Solving CSPs 



Standard Search Formulation 

Standard search formulation of CSPs 

States defined by the values 

assigned so far (partial assignments) 
Initial state: the empty assignment, {} 
Successor function: assign a value to an 
unassigned variable 
► Goal test: the current assignment is 
complete and satisfies all constraints 

We’ll start with the straightforward, 

naive approach, then improve it 





Search Methods 


What would BFS do? 


What would DFS do? 
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[Demo: coloring -- dfs] 


Backtracking Search 
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Backtracking Search 

Backtracking search is the basic uninformed algorithm for solving 

Idea 1 : One variable at a time 

Variable assignments are commutative, so fix ordering 
► l.e., [WA = red then NT = green] same as [NT = green then WA = red] 
Only need to consider assignments to a single variable at each step 



Depth-first search with these two improvements 
is called backtracking search 

Can solve n-queens for n « 25 



Idea 2: Check constraints as you go 

l.e. consider only values which do not conflict previous assignments 
Might have to do some computation to check the constraints 
“Incremental goal test” 
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Backtracking Example 



Backtracking Search 


function BACKTRACKING- SEARCH {csp) returns solution/failure 
return Recursive-Backtracking({ }, csp) 

function RECURSIVE- BACKTRACKING( assignment csp) returns soln/failure 
if assignment is complete then return assignment 
var <— Select-Unassigned-Variable( Variables [csp], assignment , csp) 
for each value in O R D ER- D o M A IN- Va L UES ( var, assignment , csp) do 
if value is consistent with assignment given CONSTRAINTS [csp] then 
add { var = value} to assignment 
result Recursive- Backtracking( assignment , csp) 
if result failure then return result 
remove {var = value } from assignment 
return failure 



Backtracking = DFS + variable-ordering + fail-on-violation 
What are the choice points? 


► 

► 



Improving Backtracking 

General-purpose ideas give huge gains in speed 
Ordering: 

Which variable should be assigned next? 

In what order should its values be tried? 



Filtering: Can we detect inevitable failure early? 


► Structure: Can we exploit the problem structure? 


Filtering 





Filtering: Forward Checking « 

Filtering: Keep track of domains for unassigned variables and cross off bad 
options 

Forward checking: Cross off values that violate a constraint when added 
to the existing assignment 



WA NT Q NSW V SA 


Filtering: Constraint Propagation 

Forward checking propagates information from assigned to unassigned 
variables, but doesn't provide early detection for all failures: 
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NT and SA cannot both be blue! 

► Why didn’t we detect this yet? 

Constraint propagation: reason from constraint to constraint 
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Consistency of A Single Arc 

An arc X -» Y is consistent iff for every x in the tail there is some y in the 
head which could be assigned without violating a constraint 



Forward checking: Enforcing consistency of arcs pointing to each new 
assignment 

Delete from the tail! 




Arc Consistency of an Entire CSP 

A simple form of propagation makes sure all arcs are consistent: 
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Important: If X loses a value, neighbors of X need to be rechecked! 
Arc consistency detects failure earlier than forward checking 

► Can be run as a preprocessor or after each assignment 

What’s the downside of enforcing arc consistency? Remember: Delete 

from the tail! 







Enforcing Arc Consistency in a CSP 


function AC-3( csp ) returns the CSP, possibly with reduced domains 
inputs: csp, a binary CSP with variables {X\, X2, . . . , X n } 
local variables: queue, a queue of arcs, initially all the arcs in csp 

while queue is not empty do 

(X*, Xj ) Remove-First (queue) 

if Remove-Inconsistent- Values^, Xj) then 
for each Xk in NEIGHBORS [X,] do 

add (X k , Xi) to queue 

function Remove- Inconsistent- Values (X*, Xj) returns true iff succeeds 
removed <— false 
for each x in DOMAIN [AC] do 

if no value y in DOMAIN [Xj] allows ( x,y ) to satisfy the constraint X \ Xj 

then delete x from Domain[X*]; removed-^- true 
return removed 


Runtime: 0(n 2 d 3 ), can be reduced to 0(n 2 d 2 ) 

... but detecting all possible future problems is NP-hard - why? 


Limitations of Arc Consistency 


After enforcing arc consistency: 

Can have one solution left 

Can have multiple solutions left 

Can have no solutions left (and not know it) 



Arc consistency still runs inside a backtracking 
search! 




What went 








K-Consistency 




K-Consistency 

Increasing degrees of consistency 


► 1 -Consistency (Node Consistency): Each single node’s domain 
has a value which meets that node’s unary constraints 

2-Consistency (Arc Consistency): For each pair of nodes, any 
consistent assignment to one can be extended to the other 

K-Consistency: For each k nodes, any consistent assignment to 
k-1 can be extended to the k th node. 


Higher k more expensive to compute 

(You need to know the k=2 case: arc consistency) 
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Strong K-Consistency 


Strong k-consistency: also k-1, k-2, ... 1 consistent 

Claim: strong n -consistency means we can solve without backtracking! 

► Why? 

Choose any assignment to any variable 
Choose a new variable 

By 2-consistency, there is a choice consistent with the first 
Choose a new variable 

By 3-consistency, there is a choice consistent with the first 2 

► ... 

Lots of middle ground between arc consistency and n -consistency! (e.g. k=3, 
called path consistency) 




Ordering 




Ordering: Minimum Remaining Values 

Variable Ordering: Minimum remaining values (MRV): 

Choose the variable with the fewest legal left values in its domain 

Why min rather than max? 

Also called “most constrained variable” 

► “Fail-fast” ordering 



Ordering: Least Constraining Value 

Value Ordering: Least Constraining Value 

Given a choice of variable, choose the least 
constraining value 

l.e., the one that rules out the fewest values in 
the remaining variables 
Note that it may take some computation to 
determine this! (E.g., rerunning filtering) 



Why least rather than most? 

Combining these ordering ideas makes 
1000 queens feasible 




Thanks 


